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(54) Method and apparatus for implementing multiple return sites 

(57) Methods and apparatus for efficiently enabling 
an alternate return address associated with a function 
call to essentially be stored such that the alternate 
return address may be readily accessed are disclosed. 
According to one aspect of the present invention, a 
method for enabling a return address associated with a 
function called by a routine to be efficiently stored 
includes calling the function from within the routine 
while the routine is executing. In general, the function is 
external to the routine. The function, once called, begins 
executing. Eventually, the function returns to the routine. 
Specif ically, the function returns to a location in the rou- 
tine that is identified by an expected return point, or nor- 
ma! return address. The instruction in the routine that 
corresponds to the expected return point is a dummy 
instruction that executes with a low computational over- 
head but does not affect program execution. When the 
called function is to return to an alternate return point it 
obtains the address by reading data embedded in the 
dummy instruction. 



figure 36 
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Description 

BACKGROUND OF THE INVENTION 

1 . Field of Invention 

[0001] The present invention relates generally to 
methods and apparatus for implementing multiple 
return points tor a call to a function. More particularly, 
the present invention relates to method and apparatus 
for efficiently enabling addresses for multiple return 
points to be obtained. 

2. Description of the Relevant Art 

[0002] Computer systems are often linked across a 
network, e.g., local area networks, intranets, and inter- 
nets, of computer systems such that they may share 
resources such as software, or program, code. Further, 
may programs, which include routines, are written such 
that a program calls "external" functions which may not 
be included within the program. In general, the functions 
may be shared by many routines, thereby allowing com- 
puter system resources to be used more efficiently. 
[0003] When a routine is arranged to call functions, 
the functions that are called must eventually return into 
the routine. Further, the returns to the routine must be 
made to the appropriate locations within the routine. 
With reference to Figure 1 , the flow between a computer 
program and functions called by the program will be 
described. Computer code 104 includes a routine gO 
108. Routine gO 108 includes instructions which are 
executed. As shown, the instructions include repeated 
calls 1 12 to a function fO 1 16. 
[0004] When function fO 1 16 is called and executes 
"normally," e.g., no exception is thrown, then function f() 
1 16 typically completes execution, and a return is made 
to routine gO 108a computer routine. The location within 
routine g() 108a computer routine to which function f() 
116 returns is dependent upon the call site, or the site 
within routine g() 108a computer routine which called 
function fO 116. Specifically, if function fO 116 executes 
as a result of call 1 12a, then function f() 1 16 returns to 
return address 120 which, as will be appreciated by 
those skilled in the art, is located immediately after call 
1 12a within routine gO 108a computer routine. Similarly, 
if function fO 116 executes when called by call 112b, 
then function fO 116 returns to return address 120. 
Once function f() 1 16 returns to routine gO 1 08a compu- 
ter routine, routine g() 108a generally continues to exe- 
cute. 

[0005] Many functions may have more than one return 
site, or point. By way of example, a function may have a 
normaJ, or expected, return point as well as an alternate 
return point. Alternate return points are often consid- 
ered to be "abnormal" return points such as return 
points associated with thrown exceptions. The alternate 
return points are typically stored, or cataloged, within an 



overall program such that the return points may be read- 
ily identified as needed. By way of example, alternate 
return points may be needed by a program during the 
processing of an exception thrown by a function which 

s does not handle exceptions. 

[0006] One mechanism used to associate functions 
with alternate return points is a return point, or return 
address, table. Figure 2a is a diagrammatic representa- 
tion of a return point table associated with a call stack 

io A call stack 204 includes a caller frame 208 which calls 
another frame, i.e., callee frame 212. Callee 212 is 
associated with a function fO 214. As such, when caller 
208 calls callee 212, function fO 214 begins to execute. 
[0007] At the end of the execution of function f() 21 4, 

is function f0 214 and, hence, callee 212 returns to caller 
208. When the return to caller 208 is not a normal 
return, then the normal return address may be used as 
an index 216 into a return point table 220 to identify the 
proper alternative return point. For example, if the nor- 

20 mal return address is "1 234", then return point table 220 
may be searched to find "1234." Once "l 234" is found, 
then the alternate return point address associated with 
"1234" may be obtained. As shown, for a normal return 
address of "1234," the corresponding alternate return 

25 point address is "1256." Once obtained, the alternate 
return point address may then be used to ensure that 
callee 212 returns to caller 208 appropriately. 
[0008] Although the use of a return point table, which 
is generally a look-up table or a hash table, is effective 

30 to identify a proper return point for a callee, the imple- 
mentation of a table look-up is often slow. A faster proc- 
ess for implementing multiple return points involves 
eliminating table look-ups to identify return points. As 
will be appreciated by those skilled in the art, during the 

55 execution of a function, it is essentially "known" to the 
function whether the function should return using a nor- 
mal return, or whether the function should return using 
an alternate return. Therefore, data pertaining to the 
alternate return address is available to be stored. 

40 [0009] Figure 2b is a diagrammatic representation of 
a routine which is arranged to store alternate return 
address data. A routine gO 236 includes a call 238 to a 
function f(). Regardless of whether call 238 to a function 
f() results in the need to return to an alternate address, 

45 call 238 would normally return to return address 240. 
Return address 240 identifies stored alternate return 
address data 242. The stored alternate return address 
data 242 is located within routine g() 236a computer 
. routine near call 238 to enable alternate return address 

so data 242 to be reacSly accessed. In general, alternate 
return address data 242 is stored in the instruction 
stream itself. Since stored atternate return address data 
242 may not represent a legal instruction, or may have 
undesirable side effects such as overwriting a value in a 

ss register or a memory cell, execution of routine g() may 
not continue at address 240 but must instead continue 
at next instruction 244. 

[001 0| When call 238 returns normally, call 238 should 
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return to next instruction 244. As shown, within routine 
gO 236, next instruction 244 is offset from stored alter- 
nate return address data 242 by a distance D. There- 
fore, when call 238 returns normally, call 238 must 
return to a location that is specified by the location of 
return address 240 incremented by offset 0, i.e., the 
location of next instruction 244. Typically, as distance D 
has a value of four bytes, next instruction 244 is offset 
from the location of return address 240 by four bytes. 
[0011] While accessing a stored alternate return 
address in a program is more time-efficient than imple- 
menting a table look-up when an alternate return 
address is needed, when an alternate return address is 
not needed, the ability to access a stored alternate 
return address often adversely affects the performance 
of the program. Adding an offset to the location of a 
return address in order to locate a subsequent instruc- 
tion to be executed when a function call returns nor- 
mally is often relatively slow, and may incur a 
performance penalty associated with computing the 
location of the subsequent instruction. In other words, 
the speed associated with a normal return may be com- 
promised by the implementation of stored alternate 
return addresses. Further, branch prediction which is 
often used to generate a "best -guess" estimate for a 
normal return, or a return which is most likely to occur, 
may be compromised by the use of jumps, as will be 
appreciated by those skilled in the art 
[001 2] Alternatively, "jumps" may be used to bypass 
the stored alternate address, as follows. Jumps, or 
branches, are often included in programs, or routines, to 
bypass sections of code which may be unnecessary in 
some situations. For example, jumps may be imple- 
mented in a routine to enable a stored alternate return 
address to be bypassed when a function call returns 
normally, as shown in Figure 2c. Within routine g0 266. 
a call 268 is made to a function fQ- When call 268 
returns normally, the return is made to the location in 
routine gO 266 specified by a return address 270. The 
location corresponding to return address 270 is an 
instruction 272 to jump to a location L which is located 
at a fixed offset F from instruction 272. Therefore, when 
call 268 returns normally to return address 270, a jump 
is made to next instruction 274. Such a jump bypasses, 
or branches around, stored alternate return address 
data 276. 

[001 3] While the implementation of jumps may reduce 
performance penalties, e.g., hardware performance 
penalties, associated with adding an offset to a return 
address in order to find the location of a subsequent 
instruction, jumps may be slow. Additional code must be 
included in a program to allow for jumps, thereby 
increasing the overall size of the program. 
[001 4] As discussed above, conventional methods for 
implementing multiple return points for function calls are 
often slow and inefficient, and, hence, the implementa- 
tion of multiple return points may adversely affect the 
performance of programs associated with the Junction 



calls. Therefore, what is desired is an efficient method 
and apparatus for implementing multiple return points 
such that both normal returns and alternate returns 
occur efficiently. 

5 

SUMMARY OF THE INVENTION 

[001 5] Methods and apparatus for efficiently enabling 
an alternate return address associated with a function 

w call to essentially be cached such that the alternate 
return address may be readily, accessed are disclosed. 
According to one aspect of the present invention, a 
method for enabling a return address associated with a 
function called by a routine to be efficiently cached 

is includes catling the function from within the routine 
while the routine is executing. In general, the function is 
external to the routine. The function, once called, begins 
executing. Eventually, the function returns to the routine. 
Specifically, the function returns to a location in the rou- 

20 tine that is identified by an expected return point or nor- 
mal return address. The instruction in the routine that 
corresponds to the expected return point is a "dummy" 
instruction that executes with a low computational over- 
head. The dummy instruction is selected to execute 

25 without affecting the normal program execution, i.e.. its 
result is not used. Instead, the purpose of the dummy 
instruction is to encode the alternate return point, or 
points, in a suitable way. 

[001 6] In one embodiment, when the function returns 
so to the routine in an expected manner, the execution of 
the function is completed prior to returning to the 
expected return point, and the execution of the dummy 
instruction has no effect. In another embodiment, when 
the function does return to the alternate return point, 
35 code is executed to access the dummy instruction 
stored at the normal return point, and the address of the 
alternate return point is computed from the library value 
that the dummy instruction represents. 
[0017] These and other advantages of the present 
40 invention will become apparent upon reading the follow- 
ing detailed descriptions and studying the various fig- 
ures of the drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

45 

[0018] The invention may best be understood by ref- 
erence to the following description taken in conjunction 
with the accompanying drawings in which: 

50 Figure 1 is a diagrammatic representation of com- 
puter code which calls an external method. 

Figure 2a is a diagrammatic representation of a call 
stack and an associated return point table. 

55 

Figure 2b is a diagrammatic representation of a 
computer routine which stores an alternate return 
address associated with a call to a function. 
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Figure 2c is a diagrammatic representation of a 
computer routine which branches past a stored 
alternate return address associated with a call to a 
function. 

Figure 3a is a diagrammatic representation of a 
computer routine which executes a dummy instruc- 
tion after a call to a function in accordance with an 
embodiment of the present invention. 

Figure 3b is a diagrammatic representation of a 
computer routine which executes multiple dummy 
instructions after a call to a function in accordance 
with an embodiment of the present invention. 

Figure 3c is a diagrammatic representation of a 
computer routine which executes a dummy instruc- 
tion before a call to a function in accordance with an 
embodiment of the present invention. 

Figure 4 is a process flow diagram which illustrates 
the steps associated with the execution of a routine 
which includes a function call with a plurality of 
return points in accordance with an embodiment of 
the present invention. 

Figure 5a is a diagrammatic representation of a 
function call which returns normally in accordance 
with an embodiment of the present invention. 

Figure 5b is a diagrammatic representation of the 
function call which results in a thrown exception 
and returns abnormally in accordance with an 
embodiment of the present invention. 

Figure 6 is a diagrammatic representation of a com- 
puter system suitable for implementing the present 
invention. 

Figure 7 is a diagrammatic representation of a vir- 
tual machine which is suitable for implementing the 
present invention. 

DETAILED DESCRIPTION OF THE EMBODIMENTS 

[001 9] When a function which is called by a computer 
program is about to return to the computer program, the 
function may return to any one of a plurality of return 
sites, or points. By way of example, a function may 
return normally, or as expected. Alternatively, a function 
may return in an alternate manner, e.g.. abnormally. 
Abnormal return sites which correspond to abnormal 
returns, must generally be stored such that they may be 
readily accessed. 

[0020] Some implementations which accommodate 
returns from a function to different points within a pro- 
gram store addresses for alternate return sites in look- 
up tables. Implementing a table look-up to locate an 



alternate return address is often slow. Other implemen- 
tations which accommodate returns to different sites 
explicitly store data relating to alternate return 
addresses near a call to the function from which a return 

5 is being made. Such implementations which involve 
explicitly storing data near a call generally either require 
extra space overhead, incur hardware performance 
penalties, or adversely affect normal returns. 
[0021] In order to implement multiple returns from 

w function calls without incurring performance penalties or 
significantly compromising the efficiency of any returns, 
data for addresses corresponding to returns may be 
embedded in an instruction which essentially performs 
no "useful" operation. That is, an instruction which has 

is substantially no dependencies and typically executes 
with very little overhead, e.g., less overhead than the 
execution of a jump, may be used to encode alternate 
return addresses. An instruction which essentially has 
no dependencies and normally executes with insigmfi- 

20 cant overhead is generally considered to be a "dummy" 
instruction. Such instructions include, but are hot limited 
to, instructions such as a move instruction or a test 
instruction. 

[0022] A move instruction is generally used to move 
25 data into a register or stack location. By way of example, 
a move instruction arranged to move a constant into an 
unused register may have a syntax such as: 

mov constant, unused_reg 
where "unused_reg" may be any register not presently 
30 containing a useful value, and "constant" may include 
data such as either an alternate return address. A test 
instruction sets processor flags depending on the value 
of a register, and may have the following syntax: 
tst constant, reg 
35 where "reg" may be any register and "constant" may 
include data associated with an alternate return 
address. 

[0023] Since the execution of a dummy instruction typ- 
ically requires an insignificant amount of computational 

40 overhead, executing a dummy instruction when a return 
from a function call is normal does not adversely affect 
the overall performance of a computer system. In other 
words, executing a dummy instruction when ri is not 
needed generally has substantially no effect on the per- 

4S formance of a computer system. Therefore, the imple- 
mentation of dummy instructions tor use with function 
calls which may result in alternate returns is relatively 
fast and efficient regardless of whether the return is a 
normal return or an alternate return. 

so [0024] A dummy instruction may generally be located 
anywhere within a program or a routine. By way of 
example, a dummy instruction may be located immedi- 
ately after a call to a function within a routine. With ref- 
erence to Figure 3a. the inclusion of a dummy 

ff instruction after a call to a function within a routine will 
be described in accordance with an embodiment of the 
present invention. A routine g() 304 generally includes 
instructions 308. A call 308a to a function fQ may either 
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return normally or abnormally. 
[0025] When call 308a to function f() returns, the 
return is made to a location in routine gO 304 which is 
specified by a return address 310. Return address 310 
identifies a dummy instruction 308b. Dummy instruction 
308b is generally located at a fixed offset, e.g., four 
bytes, from call 308a to function f(). 
[0026] In one embodiment, when call 308a to function 
fp, returns normally, then dummy instruction 308b exe- 
cutes, using essentially no overhead, especially on 
modern superscalar central processing units (CPUs) 
that may execute multiple independent instruction per 
cycle, as will be appreciated by those skilled in the art. 
Alternatively, when call 308a to function f() returns to the 
alternate return point, "rt reads the bytes comprising 
dummy instruction 308b and extracts the alternate 
return address encoded in dummy instruction 308b. 
Subsequently, execution then returns to this alternate 
return point, thereby completing the alternate return. 
[0027] After dummy instruction 308b executes, using 
essentially no overhead, as discussed above, a subse- 
quent or next, instruction 308c in routine gO 304 exe- 
cutes. It should be appreciated that instructions 308 are 
typically both preceded by and followed by many other 
instructions. 

[0028] In one embodiment, a call to a function may 
have more than one alternate, or abnormal, return. For 
example, a call to a function may be associated with 
multiple possible exceptions, as will be described in 
more detail below with respect to Figures 5a and 5b. 
When more than one abnormal return is possible, then 
multiple dummy instructions may be included near a 
function call such that each abnormal return address 
has an associated dummy instruction. Multiple dummy 
instructions may also be implemented in the event that 
a single dummy instruction is insufficient for holding all 
relevant data in a register, or stack location. 
[0029] Figure 3b is a diagrammatic representation of 
a computer routine which executes multiple dummy 
instructions after a call to a function in accordance with 
an embodiment of the present invention. As shown, rou- 
tine gO 324 includes instructions 328. Instructions 328 
may be located anywhere within routine g(] 324. In 
other words, instructions 328 may be located near the 
beginning of routine g() 324, in the middle of routine gO 
324, or substantially at the end of routine g() 324. When 
a call 328a to a function f() returns, the return is made to 
a location identified by a return address 330. Return 
address 330 identifies a first dummy instruction 328b. 
After first dummy instruction 328b executes, dummy 
instructions which follow first dummy instruction 328b 
are executed. Finally, an "Nth" dummy instruction 328c 
is executed. 

[0030] Each dummy instruction, e.g., dummy instruc- 
tions 328b, 328c. is generally located at a fixed offset 
from call 328a such that the dummy locations may eas- 
ily be located with respect to call 328a. The overall exe- 
cution of all dummy instructions uses very little 



overhead, as each dummy instruction, individually, uses 
essentially no overhead. A subsequent, or next, instruc- 
tion 328d executes after "Nth" dummy instruction 328c 
executes: 

5 [0031] tn general, a dummy instruction is not neces- 
sarily located after a call to a function which has multiple 
return sites. Dummy instructions may also be positioned 
before a call to a function with multiple return sites. With 
reference to Figure 3c, the insertion of a dummy instruc- 

10 tion before a call to a function within a routine will be 
described in accordance with an embodiment of the 
present invention. As shown, routine gO 344 includes a 
call to a dummy instruction 348a, which precedes a call 
248b to a function f0. Dummy instruction 348a is 

is located at a fixed offset from call 248b to function f(). 
That is. each time dummy instruction 348a precedes 
call 248b to function f0 within routine gO 344, dummy 
instruction 348a is at the same offset with respect to call 
248b to function fO- In one embodiment the offset is 

20 four bytes, although the offset may generally be widely 
varied. When call 348b to function f0 returns, the return 
is made to the location identified by a return address 
350. In the described embodiment, the location identi- 
fied by return address 350 includes an instruction 348a. 

25 [0032] Referring next to Figure 4, the steps associated 
with generally executing a function call in the course of 
the execution of a routine contained in a program will be 
described in accordance with an embodiment of the 
present invention. As will be appreciated by those 

30 skilled in the art. a routine which is executing may even- 
tually reach a function call. In step 402, the execution of 
a function called by a routine begins. During the course 
of the execution of the function, conditions which arise 
determine whether the call to the function will result in a 

35 normal return or in an abnormal, or alternate, return. 
[0033] When the execution of the called function in 
step 402 results in a normal return, then process flow 
branches to step 404 in which the execution of the 
called function is completed. After the execution of the 

40 called function is completed, the function returns to the 
location specified by the return address, /' e., the normal 
return address, in step 406. In the described embodi- 
ment the location specified by the return address con- 
tains a dummy instruction, e.g., a dummy instruction as 

45 shown in Figure 3a. In general, a dummy instruction 
may be any suitable approximately "no-overhead* 
instruction which embeds a constant without changing 
the internal states associated with the overall execution 
of a program. Dummy instructions may include, but are 

so not limited to, a move instruction and a test instruction, 
as previously described. 

[0034] The routine continues to execute after the 
dummy instruction executes in step 412. In general, the 
continued execution of the routine may involve the exe- 
55 cution of various instructions, such as additional func- 
tion calls and returns. When no instructions remain to 
be executed, the execution of the routine is completed. 
[0035] Returning to the execution of the called tunc- 
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tion in step 402, when the execution of the called func- 
tion is such that an alternate, e.g., abnormal, return is 
required, then from step 4-02, process flow proceeds to 
step 408 where an alternate return address is loaded 
from memory. Specifically, in one embodiment, the 
alternate return address is loaded from the normal 
return address augmented by an offset. 
[0036] Once the alternate return address is loaded, a 
jump is made from the function to the location identified 
by the alternate return address in step 410. A dummy 
instruction is treated as "data" when performing a return 
to an alternate address, thereby exploiting the fact that 
bits representing an instruction may also be regarded 
as a binary value. By way ol example, a processor may 
encode the following instruction: 

mov#1234, regl 
which moves a hexadeximal constant "1234," which 
may be an alternate return address, into a register 
"regr as a byte sequence "5B 00 00 12 34." Although 
the instruction encoding may vary between different 
processor types, any encoding will essentially identify 
all parts of the instruction, including the instruction type, 
e.g., "move," the first operand, e.g., the constant 
"1234," and the second operand, e.g., the register 
"regl - 

[0037] A compiler arranges for a dummy instruction to 
contain the alternate return address as the first operand 
of a dummy move instruction, as mentioned above. 
Therefore, with knowledge of the format of an instruc- 
tion, information such as the value of a constant e.g., 
an alternate return address, may be obtained by read- 
ing bytes two through five of the instruction as an inte- 
ger value. 

[0038] As will be appreciated by those skilled in the 
art, the dummy instruction forms a kind of pattern, 
where some of the instruction bits are fixed and some 
are variable. The fixed bits may generally not be varied 
because the instruction would otherwise be expensive 
to execute, or have side effects that interfere with the 
normal execution of the program. By way of example, 
some fixed bits may indicate the instruction type, such 
as "move." The variable bits in the instruction may be 
used to encode an arbitrary value such as the address 
of the alternate return point, By way of example, in the 
dummy instruction "5B 00 00 12 34," the byte "5B" may 
be the fixed part, indicating a move to register "regl," 
and "00 00 12 34" may be the variable part In general, 
the variable part of a dummy instruction may consist of 
substantially any combination of its instruction bits, 
including multiple non -consecutive parts, depending 
upon the particular machine instruction set used. 
[0039] From step 410, after a jump is made to the 
alternate return address, then process flow proceeds to 
step 413 where code associated with the alternate 
return address is executed. Then, the execution of the 
program continues at step 414 until execution is com- 
pleted. 

[0040] Multiple return address are useful to implement 



a variety of programming language mechanisms. By 
way of example, dummy instructions may be used to 
facilitate the execution of routines which have function 
calls that may throw exceptions. When a called function 

5 throws an exception, the exceptions generally may not 
be handled by the called function. Rather, the caller of 
the function handles exceptions thrown by the function. 
Figures 5a and 5b are a diagrammatic representation of 
a function which may either return normally or throw an 

w exception and, hence, return abnormally in accordance 
with an embodiment of the present invention. A routine 
gO 504 includes a try block 508 that calls a function f() 
512. Routine gO 504 further includes an exception han- 
dler 510 that is arranged to handle, or process, excep- 

75 tions which arise during the execution of function try 
508. 

[0041] When function fO 512 is called, and returns 
normally, e.g., no exception is thrown by function t() 
51 2, function f 0 51 2 returns to try block 508 as shown in 

20 Figure 5a. Specifically, function f() 512 returns to the 
location in try block 508 that is identified by a normal 
return address 516. In the described embodiment, the 
location identified by normal return address 516 is a 
dummy instruction, as described above with reference 

ss to Figure 3a. 

[0042] When the execution of function fO 512 results 
in an exception being thrown, as shown in Figure 5b. 
function f() 512 returns to exception handler 510. That 
is. when an exception is thrown by function fO 512, a 

30 return is made to a location specified by an alternate 
return address 520 which identifies an instruction asso- 
ciated exception handler 510. 
[0043] After exception handler 510 processes the 
exception thrown by function f() 512, function f() 512 

35 eventually continues execution at a first instruction 522 
after try block 508. The dummy instruction, in one 
embodiment, is an instruction such as a move instruc- 
tion or a test instruction that enables alternate return 
address 520 to be stored within the instruction stream. 

40 [0044] The present invention may generally be imple- 
mented on any suitable computer system. Specifically, 
the multiple return points may as described above may 
be implemented using any suitable virtual machine, 
such as the virtual machine described below with 

*s respect to Figure 7. Figure 6 illustrates a typical, general 
purpose computer system suitable for implementing the 
present invention. The computer system 730 includes 
any number of processors 732 {also referred to as cen- 
tral processing units, or CPUs) that are coupled to 

50 memory devices including primary storage devices 734 
(typically a read only memory, or ROM) and primary 
storage devices 736 (typically a random access mem- 
ory, or RAM). 

[0045] Computer system 730 or, more specifically, 
55 CPU 732, may be arranged to support a virtual 
machine, as will be appreciated by those skilled in the 
art. One example of a virtual machine that is supported 
on computer system 730 will be described below with 
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reference to Figure 7. As is well known in the art. ROM 
acts to transler data and instructions uni-directionalty to 
the CPU 732, while RAM is used typically to transfer 
data and instructions in a bi-directional manner. CPU 
732 may generally include any number of processors. 
Both primary storage devices 734, 73S may include any 
suitable computer-readable media. A secondary stor- 
age medium 738, which is typically a mass memory 
device, is also coupled bi-directionally to CPU 732 and 
provides additional data storage capacity. The mass 
memory device 738 is a computer-readable medium 
that may be used to store programs including computer 
code, data, and the like. Typically, mass memory device 
738 is a storage medium such as a hard disk or a tape 
which is generally slower than primary storage devices 
734, 736. Mass memory storage device 738 may take 
the form of a magnetic or paper tape reader or some 
other well-known device. It will be appreciated that the 
information retained within the mass memory device 
738, may, in appropriate cases, be incorporated in 
standard fashion as part of RAM 736 as virtual memory. 
A specific primary storage device 734 such as a CD- 
ROM may also pass data un i -directional I y to the CPU 
732. 

[0046] CPU 732 is also coupled to one or more 
input/output devices 740 that may include, but are not 
limited to, devices such as video monitors, track balls, 
mice, keyboards, microphones, touch-sensitive dis* 
plays, transducer card readers, magnetic or paper tape 
readers, tablets, styluses, voice or handwriting recog- 
nizers, or other wen-known input devices such as, of 
course, other computers. Finally, CPU 732 optionally 
may be coupled to a computer or telecommunications 
network, e.g., a local area network, an internet network, 
or an intranet network, using a network connection as 
shown generally at 712. With such a network connec- 
tion, it is contemplated that the CPU 732 might receive 
information from the network, or might output informa- 
tion to the network in the course of performing the 
above-descrtoed method steps. Such information, 
which is often represented as a sequence ol instruc- 
tions to be executed using CPU 732, may be received 
from and outputted to the network, for example, in the 
form of a computer data signal embodied in a carrier 
wave. The above-described devices and materials will 
be familiar to those of skill in the computer hardware 
and software arts. 

[0047] As previously mentioned, a virtual machine 
may execute on computer system 730. Figure 7 is a dia- 
grammatic representation of a virtual machine which is 
supported by computer system 730 of Figure 7, and is 
suitable for implementing the present invention. When a 
computer program, e.g., a computer program written in 
the Java* programming language developed by Sun 
Microsystems of Palo Alto, California, is executed, 
source code 810 is provided to a compiler 820 within a 
compile-time environment 805. Compiler B20 translates 
source code 810 into byte codes 830. In general, source 



code 810 is translated into byte codes 830 at the time 
source code 810 is created by a software developer. 
[0048] Byte codes 830 may generally be reproduced, 
downloaded, or otherwise distributed through a net- 

5 work, e.g., network 712 of Figure 6. or stored on a stor- 
age device such as primary storage 734 of Figure 6. In 
the descrfoed embodiment, byte codes 830 are platform 
independent. That is, byte codes 830 may be executed 
on substantially any computer system that is running a 

jo suitable virtual machine 840. By way of example, in a 
Java"* environment, byte codes 830 may be executed 
on a computer system that is running a Java 1 " virtual 
machine. 

[0049] Byte codes 830 are provided to a runtime envi- 
is ronment 835 which includes virtual machine 840. Runt- 
ime environment 835 may generally be executed using 
a processor such as CPU 732 of Figure 7. Virtual 
machine 840 includes a compiler 842. an interpreter 
844, and a runtime system 846. Byte codes 830 may 
20 generally be provided either to compiler 842 or inter- 
preter 844. 

[0050] When byte codes 830 are provided to compiler 
842, methods contained in byte codes 630 are compiled 
into machine instructions, as described above. On the 

25 other hand, when byte codes 830 are provided to inter- 
preter 844, byte codes 830 are read into interpreter 844 
one byte code at a time. Interpreter 844 then performs 
the operation defined by each byte code as each byte 
code is read into interpreter 844. In general, interpreter 

30 844 processes byte codes 830 and performs operations 
associated with byte codes 830 substantially continu- 
ously. 

[0051] When a method is called from an operating 
system 860, if it is determined that the method is to be 

35 invoked as an interpreted method, runtime system 846 
may obtain the method from interpreter 844. H, on the 
other hand, it is determined that the method is to be 
invoked as a compiled method, runtime system 846 
activates compiler 842. Compiler 842 then generates 

<o machine instructions from byte codes 830, and exe- 
cutes the machine-language instructions. In general, 
the machine-language instructions are discarded when 
virtual machine 840 terminates. 
[0052] Although only a few embodiments of the 

45 present invention have been described, it should be 
understood that the present invention may be embodied 
in many other specific forms without departing from the 
spirit or the scope of the invention. By way of example, 
although the present invention has generally been 

so descrtoed in terms of having two return points, the 
present invention may also be implemented for calls to 
functions which have more than two return points. In 
general, a dummy instruction may be added in a com- 
puter routine for each return point associated with a 

55 called function. 

[0053] Some machine instruction sets are limited to 
32 bits in length, which is generally not sufficient to 
encode the fuD 32-bH or 64-bit value that may be needed 
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to represent a complete return address. In this case, it 
may not be possible to construct dummy instructions 
that directly encode a 32-bit or 64-bit value. However, 
the present invention may still be applied to provide 
rapid access to an alternate return point. Instead of 5 
encoding the alternate return address directly in the 
dummy instruction, the distance between the normal 
return point and the alternate return .point may be 
encoded. Given this distance value, the alternate return 
point may be readily computed by adding the distance 10 
to the normal return address. Alternatively, parts of the 
address in a dummy instruction may be encoded using 
multiple dummy instructions, as described above with 
respect to Figure 3b. By way of example, a first dummy 
instruction may embed the first 16 bits of an alternate 15 
return address, while a second dummy instruction may 
embed the remaining 16 bits of a 32-bit value. 
[0054] The steps associated with the execution of a 
program which includes functions that have multiple 
return points may generally be widely varied. For exam- 20 
pie, as described above with respect to Figure 3c, a 
dummy instruction associated with a particular function 
call may precede the function call. In other words, a 2. 
dummy instruction such as a move instruction or a test 
instruction may be executed prior to the function call 2s 
which is associated with the dummy instruction without 
departing from the spirit or the scope of the present 
invention. 

[0055] The use of multiple return points is suitable for 
a variety of different purposes. As described above, so 
multiple return points may be used to facilitate the 
throwing of exceptions. Although only one example of 3. 
how exceptions may be implemented in accordance 
with the present invention has been described, it should 
be appreciated that the implementation of exceptions ss 
may be widely varied without departing from the spirit or 4. 
the scope of the present invention. The use of multiple 
return points may also be suitable for use in systems, 
e.g., a Smalltalk-based system, which utilize non-local 
returns. When multiple return points are used, the asso- *o 
ciated dummy instructions may all be located after a call 
to a function which has multiple return points. The 
dummy instructions may also all be located before the 5. 
call to the function. Finally, the dummy instructions may 
be dispersed such that some of the dummy instructions as 
are positioned before the call while others are posi- 
tioned after the call. Therefore, the present examples 
are to be considered as illustrative and not restrictive, 
and the invention is not to be limited to the details given 
herein, but may be modified within the scope of the so 
appended claims along with their full scope of equiva- 6. 
lents. 

Claims 

55 

1. A computer-implemented method for storing data 
associated with one of a plurality of return points to 
enable the data associated with the one of the plu- 



rality of return points to be efficiently obtained, the 
plurality of return points including an expected 
return point and a first alternate return point, the 
compiler-implemented method comprising: 

calling a function from within a routine while the 
routine is executing, wherein the function is 
separate from the routine; 

beginning an execution of the function; 

returning from the function to the routine, 
wherein the function returns to a location in the 
routine identified by the expected return point; 
and 

executing a first instruction in the routine, 
wherein executing the first instruction uses 
approximately no computational overhead, and 
does not significantly affect execution of the 
routine. 

A computer-implemented method as recited in 
daim 1 wherein the function returns to the routine 
as expected, the method further including: 

completing the execution of the function before 
returning to the expected return point, the 
expected return point being arranged to identify 
the first instruction in the routine. 

A computer-implemented method as recited in 
claim 2 further including continuing execution of the 
routine. 

A computer-implemented method as recited in any 
one of the preceding claims wherein beginning the 
execution of the function includes loading the first 
alternate return point, wherein the first alternate 
return point is identified by an instruction located at 
a fixed offset from the expected return point. 

A computer-implemented method as recited in 
claim 4 further including: 

aborting the execution of the called function; 
and 

jumping to the first alternate return point. 

A computer system arranged to storing data asso- 
ciated with one of a plurality of return points to ena- 
ble the data associated with the one of the plurality 
of return points to be eff iciently obtained, the plural- 
ity of return points including an expected return 
point and a first alternate return point, the computer 
system comprising: 



15 



EP0 908 813 A2 



16 



a processor; 

a calling mechanism associated with the proc- 
essor, the calling mechanism being arranged to 
call a function from within a routine while the 5 
routine is executing, wherein the function is 
separate from the routine; 

an execution mechanism associated with the 
processor, the execution mechanism being io 
arranged to begin an execution of the function; 
and 

a return mechanism arranged to return from 
the function to the routine, wherein the function is 
returns to a location in the routine identified by 
the expected return point, wherein the execu- 
tion mechanism is further arranged to execute 
a first instruction in the routine, wherein execut- 
ing the first instruction uses approximately no so 
computational overhead, and does not signifi- 
cantly affect execution of the routine. 

7. A computer system as recited in claim 6 wherein 
the function is arranged to return to the routine as 25 
expected, the execution mechanism further being 
arranged to complete the execution of the function 
before returning to the expected return point, the 
expected return point being arranged to identify the 
first instruction in the routine. 30 

8. A computer system as recited in one claims 6 and 7 
wherein the execution mechanism further includes 
a loader arranged to load the first alternate return 
point, the first alternate return point being identified 35 
by an instruction located at a fixed offset from the 
expected return point. 

9. A computer program product for storing data asso- 
ciated with one of a plurality of return points to ena- 40 
We the data associated with the one of the plurality 

of return points to be efficiently obtained, the plural- 
ity of return points including an expected return 
point, the computer program product comprising: ^ 

computer code for catling a function from within 
a routine while the routine is executing, wherein 
the function is separate from the routine; 

computer code for beginning an execution of so 
the function; 

computer code for returning from the function 
to the routine, wherein the function returns to a 
location in the routine identified by the 55 
expected return point; 

computer code for executing a first instruction 



in the routine, wherein executing the first 
instruction uses approximately no computa- 
tional overhead, and does not significantly 
•affect execution of the routine; and 

a computer-readable medium that stores the 
computer codes. 

10. A computer program product according to claim 9 
wherein the computer -readable medium is one 
selected from the group consisting of a data signal 
embodied in a carrier wave, a CD-ROM, a compu- 
ter disk, a computer tape, and a computer disk 
drive. 

11. A computer-implemented method for storing data 
associated with one of a plurality of return points to 
enable the data associated with the one of the plu- 
rality of return points to be efficiently obtained, the 
plurality of return points including an expected 
return point and a first alternate return point, the 
computer-implemented method comprising: 

executing a routine; 

accessing a function from within the routine 
while the routine is executing, the function 
being substantially separate from the routine; 

initiating execution of the function; 

returning from the function to the routine, 
wherein the function returns to a location in the 
routine identified by the expected return point; 
and 



executing a first instruction in the routine, 
wherein executing the first instruction does not 
significantly affect the speed of the overall exe- 
cution of the routine. 

12. A computer-implemented method as recited in 
claim 11 further including: 

determining when the function returns to the 
routine as expected; and 

completing the execution of the function before 
returning to the expected return point when the 
function returns to the routine as expected, the 
expected return point being arranged to identify 
the first instruction in the routine. 

13. A computer-implemented method as recited in any 
one of the preceding claims wherein initiating the 
execution of the function includes identifying the 
first alternate return point, wherein the first alter- 
nate return point is identified by an instruction 
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located at a fixed offset from the expected return 
point. 

14. A computer-implemented method as recited in 
claim 13 further including: s 

aborting the execution of the function; and 

jumping to the first alternate return point. 

10 

15. A computer-implemented method for executing a 
routine, the routine including a function call and a 
plurality of return points, the computer-imple- 
mented method comprising: 

15 

beginning execution of the routine; 

initiating execution of the function call; 

loading a first return address associated with 20 
the routine; 

returning from the function call to the first return 
address; 

25 

executing code associated with the first return 
address, wherein executing code associated 
with the first return address includes interpret- 
ing bits associated with an instruction as a 
binary value; and 30 

continuing execution of the routine. 
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(54) Method and apparatus for implementing multiple return sites 

(57) Methods and apparatus for efficiently enabling 
an alternate return address associated with a function 
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tine that is identified by an expected return point, or nor- 
mal return address. The instruction in the routine that 
corresponds to the expected return point is a dummy 
instruction that executes with a low computational over- 
head but does not affect program execution. When the 
called function is to return to an alternate return point it 
obtains the address by reading data embedded in the 
dummy instruction. 
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